Optimal scaling of discrete approximations to Langevin diffusions

نویسندگان

  • Gareth O. Roberts
  • Jeffrey S. Rosenthal
  • Richard Gibbens
  • Michael Miller
چکیده

We consider the optimal scaling problem for proposal distributions in Hastings-Metropolis algorithms derived from Langevin diffusions. We prove an asymptotic diffusion limit theorem and show that the relative efficiency of the algorithm can be characterised by its overall acceptance rate, independently of the target distribution. The asymptotically optimal acceptance rate is 0.574. We show that as a function of dimension n, the complexity of the algorithm is O(n), which compares favourably with the O(n) complexity of random-walk Metropolis algorithms. We illustrate this comparison with a number of example simulations.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Tempered Langevin diffusions and algorithms

We consider a class of Langevin diffusions with state-dependent volatility. The volatility of the diffusion is chosen so as to make the stationary distribution of the diffusion with respect to its natural clock, a heated version of the stationary density of interest. The motivation behind this construction is the desire to construct uniformly ergodic diffusions with required stationary densitie...

متن کامل

Optimal scaling of discrete approximations to Langevin di usionsbyGareth

Acknowledgements. We are grateful to Radford Neal for bringing references from the physics literature to our attention. We also thank Richard Gibbens, Michael Miller, and Richard Tweedie, for helpful discussions, and would like to thank the referees very much for their work. Abstract. We consider the optimal scaling problem for proposal distributions in Hastings-Metropolis algorithms derived fr...

متن کامل

Optimal Scaling of the Mala Algorithm with Irreversible Proposals for Gaussian Targets

Abstract. It is known that reversible Langevin diffusions in confining potentials converge to equilibrium exponentially fast. Adding a divergence free component to the drift of a Langevin diffusion accelerates its convergence to stationarity. However such a stochastic differential equation (SDE) is no longer reversible. In this paper, we analyze the optimal scaling of MCMC algorithms constructe...

متن کامل

Gaussian Approximations of Small Noise Diffusions in Kullback-leibler Divergence

Abstract. We study Gaussian approximations to the distribution of a diffusion. The approximations are easy to compute: they are defined by two simple ordinary differential equations for the mean and the covariance. Time correlations can also be computed via solution of a linear stochastic differential equation. We show, using the Kullback-Leibler divergence, that the approximations are accurate...

متن کامل

Fast Communication Gaussian Approximations of Small Noise Diffusions in Kullback–leibler Divergence∗

We study Gaussian approximations to the distribution of a diffusion. The approximations are easy to compute: they are defined by two simple ordinary differential equations for the mean and the covariance. Time correlations can also be computed via solution of a linear stochastic differential equation. We show, using the Kullback–Leibler divergence, that the approximations are accurate in the sm...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1995